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(54) Approximate fitness functions 

(57) A framework for managing approximate mod- 
els in generation-based evolution control is proposed. 
This framework is well suited for parallel evolutionary 
optimization that is able to guarantee the correct con- 
vergence of the evolutionary algorithm and to reduce the 
computation costs as much as possible. Control of the 
evolution and updating of the approximate models are 
based on the estimated fidelity of the approximate mod- 



el. The frequency at which the original function is called 
and the approximate model is updated is determined by 
the local fidelity of the approximate model. By local fi- 
delity the fidelity of the model for the region where the 
current population is located is designated. The lower 
the model fidelity is, the more frequently the original 
function should be called and the approximate models 
should be updated. 
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Description 

[0001] The present invention relates to a method for the evolutionary optimization, to a computer software program 
for executing such a method as well as to the use of such a method for the optimization of aerodynamic structures. 
[0002] With reference to figure 1 at first the well-known cycle of an evolutionary algorithm will be explained. 
[0003] In a step 1 the object parameters to be optimized are encoded in a string called individual. A number of such 
individuals are randomly generated that comprises the initial parent generation and the quality (fitness) of each indi- 
vidual in the parent generation is evaluated. In a step S2 the parents are reproduced by applying genetic operators 
called mutation and recombination. Thus, a new generation is reproduced in step S3, which is called the offspring 
generation. The quality of the offspring individuals is evaluated using a fitness function which is the objective of the 
optimization in step S4. Finally, depending on the calculated quality value, step S5 selects the best offspring individuals 
(survival of the fittest) which are used as parents for the next generation cycle if the termination condition in step S6 
is not satisfied. 

[0004] Before evaluating the quality of each individual, decoding may be needed depending the encoding scheme 
used in the evolutionary algorithm. Note that the steps S2, S3, S4, S5 and S6 are cyclically repeated until the condition 
for termination of the optimization in step S6 is satisfied. 

[0005] The algorithm of this evolutionary optimization can be expressed by the following pseudo-code: 

t: = 0 

encode and initialize P(0) 
decode and evaluate P(0) 
do 

recombine P(t) 
mutate P(t) 
decode P (t) 
evaluate P (t) 
P(t+1) = select P(t) 
encode P (t+1) 
t: =t+1 

until terminate 

[0006] Such evolutionary algorithms are known to be robust optimizers that are well suitable for discontinuous and 
multi-modal objective functions. Therefore, evolutionary algorithms have successfully been applied to mechanical and 
aerodynamic optimization problems, including preliminary turbine design, turbine blade design, multi-disciplinary rotor 
blade design, multi-disciplinary wing platform design and a military airframe preliminary design. 
[0007] Details on the evolutionary algorithms can be found in Dasgupta et al. "Evolutionary Algorithms in Engineering 
Applications", Springer-Vertag, 1 997 and Miettinnen et al., "Evolutionary Algorithms in Engineering and Computer Sci- 
ence", John Wiley and Sons. 1 999. 

[0008] One essential difficulty in generation-based approaches to aerodynamic optimization is the huge time con- 
sumption due to the high complexity of the aerodynamic analysis and the large number of evaluations needed in the 
evolutionary optimization. To address this problem, several methods have been developed for constructing approximate 
models. 

[0009] One widely used method in design engineering is the Response Surface Methodology, which uses low-order 
polynomials and the least square estimations. 

[0010] A more statistically sound method is the Kriging model, which is also called the Design and Analysis of Com- 
puter Experiments (DACE) model. In this method, a global polynomial approximation is combined with a local Gaussian 
process and the Maximum Likelihood is used for parameter estimation. Artificial neural networks, including Multi-layer 
Perceptrons (M LP) and Radial Basis.Function Networks (RBFN) have also been employed to build approximate models 
for design optimization. 

[001 1 ] A MLP neural network can be used for building an approximate model. However, it is generally difficult to get 
a model with sufficient approximation accuracy. One of the problems is the lack of training data for the neural network, 
because for many real application data collection is a computationally expensive process. This is especially true when 
the dimension of the problem space is high. Due to this, the approximate model may be of low fidelity and may even 
introduce false optima. In this case, measures need to be taken to guarantee the correct convergence of the optimization 
algorithm when approximate models are used. 

[0012] Managing approximate models in optimization based on evolutionary algorithms has not caught much atten- 
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tion so far. It Is known to use a heuristic convergence criterion to determine when the approximate model must be 
updated. The basic idea is that the convergence of the search process should be stable and therefore, the change of 
the best solution should not be larger than a user-defined value. An assumption is that the first sets of data points are 
at least weakly correlated with the global optimum of the original problem, which is not necessarily true for high dimen- 
5 sional systems. 

[0013] An approach to coupling approximate models with evolutionary algorithm has been proposed in an attempt 
to balance the concern of optimization with that of design of experiments. The main idea is to maintain the diversity of 
the individuals and to select those data points that are not redundant for model updating (online learning). In this 
method, the decision of when to carry out the on-line learning of the approximate model is simpfy based on a prescribed 
10 generation delay. 

[0014] Most recently it has been proposed to train a neural network with some initial samples to approximate the NK 
model. During evolution, the fittest individual in the current population is evaluated on the original fitness function for 
every 60 generations. This individual then replaces the one with the lowest fitness in the training set and the neural 
network is retrained. It has been found that the evolutionary algorithm becomes misled by the neural network model 
is when the complexity of the original fitness landscape is high. The common weakness in the above methods is that 
neither the convergence properties of the evolutionary algorithm with approximate fitness functions (correct conver- 
gence is assumed) nor the issue of model management is addressed. 

[0015] In view of the above it is the object of the present invention to reduce the computation time and complexity 
when managing approximate models for fitness functions. At the same time the convergence properties of the algorithm 

20 should essentially not be degraded. 

[0016] Therefore, a framework for model management with generation based control is proposed. Generally, gen- 
eration based evolution control is more suitable when the evaluation of the fitness function is implemented in parallel. 
The main idea is that the frequency at which the original computationally expensive function is called and the approx- 
imate model is updated should be determined by the local fidelity of the approximate model. By local fidelity, the fidelity 

25 of the model for the region where the current population is located is meant. The lower the model fidelity is, the more 
frequently the original function should be called and the approximate model should be updated. Since it is hardly 
possible to build a globally correct approximate model for problems with large dimensionality of the design space, a 
local model is of more practical importance. With this strategy, the computational cost can be reduced as much as 
possible while the correct convergence of the evolutionary algorithm can be guaranteed. 

30 [0017] The above object is particularly achieved by means of the features of the independent claims. The dependent 
claims develop further the central idea of the invention. 

[0018] According to the present invention therefore a method for the evolutionary optimization with approximate 
fitness functions is proposed. At first an initial design is set up. The initial design is reproduced to create a plurality of 
offsprings. The quality of the offsprings is evaluated by means of a fitness function. Finally, the offsprings having the 

35 highest evaluated quality value are selected for the next generation cycle. Selectively, an original fitness function or 
an approximate fitness function can be used for the quality evaluation step. According to the invention the frequency 
of the use of the original .fitness function is adaptivefy adjustable during the optimization process (online adaptation). 
[0019] The approximate fitness function can be refined (updated) on every use of the original fitness function. 
[0020] A covariance matrix of the probability density function adapted during the evolutionary optimization can be 

40 used for weighting new samples on every update of the approximate fitness function. 

[0021] The fidelity of the approximate fitness function can be estimated locally on every use of the original fitness 
function to adjust the future frequency of use of the original fitness function. 

[0022] On every use of the original fitness functions the current model error can be calculated on the basis of the 
difference of the result of using the original fitness function and the approximate fitness function, respectively. The 
45 future frequency of use of the original fitness function can then be adapted (online) on the basis of the current model 
error. 

[0023] The approximate fitness function can be implemented by means of a neural network model. 

[0024] According to a further aspect of the present invention a computer software program for executing such a 

method is proposed. 

so [0025] According to the present invention such a method can be used for structural optimization problems, particularly 
the optimization of aerodynamic bodies, in which case the original function can be calculated by a Navier-Stokes solver. 
[0026] Further aspects, objects, features and advantages of the present invention will become evident for the man 
skilled in the art when reading the following detailed description of an embodiment taken in conjunction with the figures 
of the enclosed drawings. 

55 

Figure 1 shows a graphical representation of a generation cycle of an evolution strategy, 

Figure 2 is a schematic representation of control cycles using an approximate model or an original function, 
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Figure 3 shows a flow chart for the online adaptation of the use frequency of an original fitness function, 

Figure 4 shows an example of the application of the present invention on a spline encoded blade construction, 

5 Figure 5 shows a simulation of blade optimization with approximate models, and 

Figure 6 shows an example for the optimization of blades without approximate models. 

[0027] Figure 2 shows the technique of calculating a fitness evaluation using both approximate models (for example 
10 implemented by means of neural network models) and the original function according to adaptive control cycle. A 
control cycle is terminated by one fitness evaluation using the original function preceded by no, one or a plurality of 
fitness evaluations using the approximate model. Obviously the original function is not used for every generation in a 
control cycle. The control cycle 1 in figure 2 is composed of two generations using the approximate model and is 
terminated by one generation using the original function, whereas the control cycle 2 is composed of one generation 
*5 using the approximate model and is terminated by one generation using the original function. In this example at the 
end of the control cycle 1 it has been decided to increase the frequency of use of the original function. 
[0028] Figure 3 shows a flow chart of a process of the present invention for online adaptation of the use frequency 
r\ (t) of the original function, wherein t is the generation number. After the begin the initial design is fixed in step S1 . 
Then an initial control frequency r\{0) is f ixed in step S7. Depending on the control frequency in an evolution control 
20 step S8 it is decided whether the evaluation of the fitness should be performed with the original function (step S9) or 
with the approximate model (step S11). Usually the evolution control step S8 is designed such that the original function 
is used in step S9 to terminate a control cycle. 

[0029] In case the original function is used in step S9 for the evaluation, the data of the result of this evaluation are 
collected in step S10. 

25 [0030] At the end of a generation cycle (composed of steps S2 to S6 as explained with reference to figure 1) it is 
decided in step S1 2 whether the current control cycle is finished. If not, the processing goes back in a step S14 to the 
evolution control decision step S8. If the end of a control cycle is reached, go to step S13 in which the approximate 
model (the neural network) is updated using the data collected in step S1 0. Based on an estimation of the model fidelity 
(as will be explained later on) the future use frequency of the original function Tj(t) is calculated in step S1 3. Depending 

30 on the requirements and the result of the evolution steps S9 or S11 , respectively, either the final design is output or 
the processing goes back in step S14 to the evolution control decision step S8 to start a new control cycle. 
[0031] The theoretical background of the present invention will now be explained. 

[0032] The canonical Evolution Strategy (ES) operates on an n-dimensional vector x e IR". The main operator in 
ES is the mutation operator. However, unlike in the canonical genetic algorithm (GA), the mutation operator obtains a 

35 direction during search due to the self-adaptation of the strategy parameters. The combination of the genotypes from 
different parents, carried out by the recombination operator in ES or the crossover operator in GA, usually plays a less 
significant role or is completely omitted like in this study. The Evolution Strategy is typically combined with a deterministic 
selection method, either with elitism, i.e., (u.+X)-ES, or without elitism, i.e., (p,,X)-ES. At the same time, the combination 
with other selection methods, e.g., the EP tournament selection is known to be successful. The Oi,X)-ES is applied 

40 here, thus u. new individuals are only selected from the X offspring. The canonical Evolution Strategy (ES) can be 
described as follows: 



45 



50 



x(0 = x(/-l) + ? (1) 

o/O = o£t ' 1)exp(r'z)exp(iz / ), V/ e{1 n] (2) 



x.fe/R"; z i9 z *tf(0,l); z N{0 9 a(i) 2 ) (3) 

where x is the parameter vector to be optimized and r, t and 0| are the strategy parameters. The values for r and r* 
55 are fixed to 
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r=(&fa*\ r> = (j2n)\ (4) 

[0033] The z^z and ? are normally distributed random numbers and a random number vector, respectively, which 
5 characterize the mutation exercised on the strategy and the objective parameters. The oj are also called step-sizes 
and are subject to self-adaptation , as shown in equation (2). Since they define the variances a 2 of the normal probability 
distribution, equation (3), for the mutation in equation (1), they stochastically define a direction and a step-length of 
the search process in the n-dimensional space. However, arbitrary directions can only be represented by correlated 
mutations, i.e., the covariance matrix of the normal distribution should have non-zero off-diagonal elements. Such 
10 correlated mutations are realized by the Covariance Matrix Adaptation (CMA) algorithm. 

[0034] The de randomized Covariance Matrix Adaptation (CMA) differs from the standard ES mainly in three respects: 
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In order to reduce the stochastic influence on the self-adaptation, only one stochastic source is used for the ad- 
aptation of both objective and strategy parameters. In the derandomized approach the actual step length in the 
objective parameter space is used to adapt the strategy parameter. Therefore, the self-adaptation of the strategy 
parameters depends more directty on the local topology of the search space. In the case of the adaptation of one 
strategy parameter, this can be written as 



x(r) = x(f-1) + o(f)z (6) 
z«fV(5,T). 

[0035] Therefore, in the derandomized approach the actual step length in the objective parameter space is used to 
adapt the strategy parameter. This results in the following, simple, however successful, effect: If the mutation was 
larger than expected (frD^ 5 ^ then the strategy parameter is increased. This ensures that if this larger mutation was 
successful (i.e. the individual was selected), then in the next generation such a larger mutation will again occur, because 
u(t) was increased. The same argumentation holds if (M^MB The parameter d is used to regulate the adaptation. 

• The second aspect is the introduction of the cumulative step size adaptation. Whereas the standard evolution 
strategy extracts the necessary information for the adaptation of the strategy parameters from the population (en- 
semble approach), the cumulative step size adaptation relies on information collected during successive genera- 
tions (time averaged approach). This leads to a reduction of the necessary population size. The cumulation of 
steps is termed evolution path by Ostermeier and Hansen and is formally expressed as: 

s(0=(1-c)S(r-t) + c„z (7) 



[0036] The facto redetermines the length of the evolution path and the factor c u = jc(2-c) is needed for normalization, 
which can be seen by calculating the variance of s(f) in the limit t «>. 

• In the CMA algorithm, the full covariance matrix £ of the probability density function 



/(*> = „ <"W - d' " (8) 



is adapted for the mutation of the objective parameter vector. The following description of the CMA algorithm 
follows the one given in N. Hansen and A. Ostermeier, "Adapting arbitrary normal mutation distributions in evolu- 
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tions strategies: The covariance matrix adaptation", in Proc. 1996 IEEE Int. Conf. On Evolutionary Computation, 
pages 312-317, IEEE Press, 1 996, details of the implementation can be found in M Kreutz, B. Sendhoff, and Ch. 
I gel, "EALib: A C++ class library for evolutionary algorithms", Institut fur Neuroinformatik, Ruhr-Universitat Bo- 
chum, 1.4 edition, March 1999. 

[0037] If the matrix B satisfies 5 = SS^and z,« N(0,1 ), then Sz « N(Q,£). The adaptation of the objective vector is 
given by: 

x(r) = x(t - 1) + 5(f - 1)3(f - 1)z, z, * N(0,1) (9) 

where 8 is the overall step size. The adaptation of the covariance matrix is implemented in two steps using the cumu- 
lative step size approach (c^, e (0,1 )andc e (0,1)) determine the influence of the past during cumulative adaptation). 

s(f) = (1-c)s(f-1)+c u 3(f-1)z (10) 

5(f) = (1 - c m )Z(t- 1) + c w s(r)s T (0 (11) 

[0038] The next step is to determine the matrix 3 from (5.Since<5= $Z$ r is not sufficientto derive 5, the Eigenvectors 
of 5 are chosen as column vectors. The reason is that in the last step the overall step size 6 has to be adapted. In 
order to perform this adaptation, the expected length of the cumulative vector s 6 has to be known. 
[0039] Therefore, the variation vector should be N(0,T) distributed. 

s 6 (f) = d- c)s 6 (f - 1) + c&it - 1)z (12) 

W = ^-l)-«p(A(0|-*.) (13) . 

x ' 5 6 equals 5 with 

normalized columns in order for 5 6 (f - 1 )z to be Afi(0,T) distributed, ^denotes the expectation of the distribution, 

35 which is the distribution of the length of an N(0,f ) distributed random vector. 

[0040] The CMA algorithm relies on several external parameters which have to be fixed manually. 
Parallel Implementation of the Evolutionary Algorithm 
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[0041] The basic motivation to implement an evolutionary algorithm in parallel is to reduce the processing time need- 
ed to reach an acceptable solution. This is badly in need when the evaluation of the fitness takes a large amount of 
time. There are several approaches to parallelization and the one adopted here is the global parallelization. In this 
approach there is one single population and the evaluation of the individuals is done in parallel. For design problems, 
the evaluation of the individuals usually takes up the overwhelming part of the total time consujption, therefore, a sub- 
ilinear speed-up can be achieved if the global parallelization approach is used. The hardware for the implementation 
of parallel evolutionary algorithms can be very different. In our case, a network of computers with multi-processors is 
used. The implementation of the parallelization is realized with the Parallel Virtual Machines library. 

EMPIRICAL CONVERGENCE STUDIES AND EVOLUTION CONTROL 

Convergence of the Evolution Strategy with Neural Networks for Fitness Evaluations 

[0042] Now the convergence properties of the evolution strategy when a trained multilayer perceptron (MLP) neural 
network is used for fitness evaluations will be evaluated. 

[0043] The investigation is carried out on two benchmark problems, the Ackley function and the Rosenbrock function. 
The Ackley function is a continuous, multimodal test function, which has the following form: 
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/,(*) = "20 




+20+e 



(14) 



where n is the dimension of the function. A neural network is trained to approximate the 2D Acldey function. In the 
simulation, 600 training data are collected from one run of evolution with the Ackley function as the objective function. 
10 This is to simulate the situation that training data are only available from earlier optimization attempts in real world 
applications. The MLP network used has one hidden layer with 20 nodes. 

[0044] A false minimum exists near [x v x$ = (1, -4). This can be ascribed to the poor distribution of the training 
samples. Such samples can be used to simulate the situation frequently encountered in practice, i.e. sparse and poorly 
distributed training data. Recall that for the discussed problems data collection is expensive. If the evolutionary algo- 
is rithm is run with this neural network model, the algorithm converges to the false minimum, which is an expected result. 
[0045] To show that the identified problem is a general one, simulations are also conducted oil the Rosenbrock 
function. 



25 [0046] For his function, the evolutionary algorithm is expected to easily find a near minimum but difficult to locate 
the global minimum. The output of the fitness function spans from thousands to zero and therefore it becomes a little 
more difficult for the neural network to learn the mapping. The simulation is conducted on the 2-0 Rosenbrock function. 
Similarly 1 50 samples are generated from one run of evolution on the2-D Rosenbrock function, which is much smoother 
compared to the Ackley function. 

30 [0047] Comparing it with the true 2-D Rosenbrock function, it is seen that the left ram of the 2D-Rosenbrock function 
becomes almost flat due to the poor distribution of the training data. No doubt, evolution with this neural network model 
is vulnerable to serious errors, because the global minimum of this approximate model lies in the area where the true 
value is very large. Therefore, an evolutionary optimization based on such an approximate model will converge to the 
false minimum. 

35 

Adding Random Samples 

[0048] One straightforward idea of dealing with the problem is to add some randomly generated samples for neural 
network training, first without considering the cost of data generation. In the simulation, 1 50 random samples are added 
40 to the original training data, both for the 2-D Ackley function and the 2-D Rosenbrock function. It is found that the neural 
networks are able to learn the main features of the functions and no false minima are present. This is confirmed by 
running the evolution process with the neural network model as the fitness function, in which a near-optimum is found 
for both functions. 

[0049] Unfortunately, adding random samples does not work for high-dimensional systems. To illustrate this, simu- 
45 lations are conducted on the 12-D Ackley function and the 12-D Rosenbrock function. In both cases, 450 randomly 
generated samples are added to 1 000 training data. 450 random samples are added just because in real applications, 
it is impossible to have as much data as needed. Despite that the neural networks have achieved a good approximation 
on the training data, incorrect convergence has occurred for both functions. 

so Improvement of Convergence with Controlled Evolution 

[0050] In the last subsection, it was shown that using additional training samples is not effective to deal with the 
problem of "incorrect" convergence of evolutionary algorithms with neural network models. Therefore the concept of 
evolution control is introduced. Two methods are proposed: 

55 

Controlled individuals: 

[0051] In this approach, part of the individuals fa) in the population (X in total) are chosen and evaluated with the 
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real fitness function. If the controlled individuals are chosen randomly, it can be called a random strategy. If the best 
T| individuals are chosen as the controlled individuals, it is called a best strategy. 

Controlled generations: 

5 

[0052] In this approach, the whole population of t) generations will be evaluated with the real fitness function in every 
X generations, where tj<X. 

[0053] Furthermore, when controlled individuals or controlled generations are introduced, new training data are avail- 
able. Therefore, on-line learning of the neural network will be applied to improve the approximation of the network 

10 model in the region of optimization and in turn to improve the convergence of the evolutionary algorithm. 

[0054] First the individual based methods for the 1 2-D Ackley function are investigated. To determine the number of 
individuals (r\) that need to be evaluated using the original fitness function to guarantee correct convergence, an r) = 
1 ,2,...,11 is tested for both the random strategy and the best strategy for a (n, X)= (3, 1 2)-ES. 
[0055] All the results are averaged over 10 runs. It can be seen that for the random strategy, convergence of the 

is evolutionary algorithm is not achieved until T|>9. When 5 out of 1 2 individuals are evaluated with the real fitness function, 
the reported best fitness is close to the true fitness. When t\ is larger than 7, a near-optimum is found. 
[0056] When some of the individuals are evaluated using the real fitness function, new data are available and on- 
line learning can be implemented. In the following, it is investigated in which way the algorithm can benefit, if these 
newly available data are used to train the neural network on-line. The evolutionary algorithm reports a correct fitness 

20 when only 2 individuals are evaluated with the real fitness function. When about 50% of the whole population are 
evaluated with the real fitness function, a good near-optimal or optimal solution is found. 

[0057] Similar results have been obtained for the 1 2-D Rosen brock function. It is seen that when tj>6, the algorithm 
converges to the correct fitness value and a near-optimal solution is found. When on-line learning is introduced, the 
convergence properties improve considerably and the resulting solution is near-optimal when T|>5. In both cases, the 
25 results are based on an average of 1 0 runs. 

[0058] It is shown that the best strategy works much better than the random strategy and on-line learning can further 
improve the convergence properties. 

A FRAMEWORK FOR MANAGING APPROXIMATE MODELS 

30 

[0059] Now a framework for managing approximate models in evolutionary optimization is suggested. Taking into 
account the fact that parallel evolutionary algorithms are often used for design optimization, the generation-based 
evolution control strategy is used in this framework. 

35 Generation-based Evolution Control 

[0060] As explained above, generation-based evolution control is one of the approaches to guarantee the correct 
convergence of an evolutionary algorithm when the approximate fitness model has false minima. The idea in the gen- 
eration based evolution control is that in every X generations there are regenerations that will be controlled, where t\<X. 
40 t| should be generally larger than X/2 to ensure the correct convergence when false global minima are present in the 
approximate model. However, an adaptive control frequency (-nA) is proposed so that the calls of the original expensive 
fitness function can be reduced as much as possible without affecting the correct convergence of the algorithm. 

Determination of Control Frequency 

45 

[0061] The higher the fidelity of the approximate model is, the more often the fitness evaluation can be made using 
the model and the smaller^ can be. However, it is very difficult to estimate the global fidelity of the approximate model. 
Thus, a local estimation of the model fidelity is used. This is feasible because the evolution strategy generally proceeds 
with small steps, i.e., with the normal distribution small mutations are most likely. Therefore the current model error is 
so used to estimate the local fidelity of the approximate model and then to determine the frequency at which the original 
fitness function is used and the approximate model is updated. The frequency is denoted by r\fk. When X is fixed, the 
frequency is solely determined by r\. 

[0062] To get a proper t|, heuristic fuzzy rules can be derived as follows: 
If the model error is large, then rj is targe 
55 [0063] Since the rule system has only one input variable, the input-output mapping of such a fuzzy system can be 
approximately expressed by: 
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(16) 



where [x] denotes the largest integer that is smaller than x, Tj max is the maximal tj, ti max <X I and r\ min usually equals 1 
so that the information on the model fidelity is always available. is the allowed maximal model error and E(k) is 
the current model error estimation, k denotes the k-th cycle of X generations. Every X generations is called a control 
cycle. 

[0064] The estimation of the current model error is carried out before the next control cycle begins. Suppose all the 
new data in the last r\ generations are valid (in aerodynamic design, some design may result in unstable fluid dynamics 
and therefore the data may be invalid) and the population size is P, then there will be r\P data in total. Thus, the model 
error is estimated as follows: 



where y(i) is the true fitness value and y NN fi) is the fitness calculated using a feed-forward neural network model: 



where H is the number of hidden nodes, n is the number of inputs, w fj and v } are the weights in the input layer and 
output layer, and 6(.) is the logic function 




(17) 




(18) 



G(Z) = 



1 



(19) 



1+e 



-z 



[0065] The framework for evolutionary optimization with approximate models can be summarized as follows (see 
also the already explained flow-chart of figure 3): 
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Begin 

Initialize P(0), rtfO), X, E^, t^, let k=0 
for t=0 to W 

if (t%X)<T](k)-l 

Use the original fitness function 
Collecting new data 

else 

Use the approximate model 

and if 

if(t%X)=X-l 

Estimate the local model fidelity E(k) 
Estimate T](k+1), k=k+l 
Select the data for model updating 
Update the approximate model 

end if 

end for 
End 

[0066] Recall that the fidelity of the model is estimated locally based on the error information from the last cycle. 
35 Therefore, X should not be too large. 

Weighted Online Learning Using Covariance Matrix 

[0067] An important issue in on-line learning is how to select new samples for network training to improve the model 
40 quality as much as possible. A simple way is to use all the new samples, or a certain number of the most recent data, 
if the neural network can learn ail the data well. Unfortunately, in on-line learning, only a limited number of iterations 
of training are allowed to reduce the computation time. 

[0068] There are a number of methods for data selection in neural network training, which are usually called active 
learning. However, all of these methods rely on sufficient data in order to employ methods from statistics. In the problem 

45 outlined in this description, data are sparse and their collection is computationally expensive. At the same time, infor- 
mation about the topology of the search space and even more importantly about the direction of the search process 
is contained in the covariance matrix which is adapted during the evolutionary process. To exploit this information, the 
shape of the normal distribution, equation (8), is used to weight the newly generated samples. In this way, the neural 
network will put more emphasis on the data points that the evolution strategy will most probably visit in the next gen- 

50 eration. 

[0069] Suppose there are N new samples in total, then the cost function for weighted learning is given by 

^TrZrtOCKO-^O)) 2 (20) 

where, p(t) is the weight for sample / 
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rfO = «pQx(/) r C- l x(o) (21) 

5 

[0070] The covariance matrix 5 is the one which is adapted during the evolutionary search in the CMA algorithm 
outlined further above. Before applying the weights to neural network learning, they need to be normalized 

P(')=f& (22) 

where p max is the maximal weight among p(i), #=1 ,2,...,A/. In this way, the neural network is able to learn the most 
is important samples, and those with a weight smaller than a given threshold are discarded in learning. 

Application of the present invention: Aerodynamic Design Optimization 

[0071 ] One of the main difficulties in aerodynamic design optimization is the tremendous time consumption in quality 
20 evaluation. Generally, a 2-D or 3-D Navrer-Stokes solver with turbulence model is used for computing the fluid dynamics, 
which usually takes hours of CPU time to get a solution. 



Table 1: 
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Generation-based control with weighted online learning 


j No. 


1 


2 


3 


4 


5 


6 


7 


8 


9 


10 


Average 


Best Fitness 


20.6 


23.9 


22.9 


16.7 


25.2 


18.1 


36.0 


56.8 


38.0 


22.5 


25.8 


Number of calls 


996 


948 


936 


900 


960 


960 


876 


1164 


852 


888 


948 



30 

[0072] The objective of the optimization is to maximize the efficiency of a turbine blade and to minimize the bias of 
the outflow angle from a prescribed value. The maximization of efficiency is realized by the minimization of the pressure 
loss. In addition, mechanical constraints must be satisfied concerning stability and manufacturing. In order to describe 
the two dimensional cross section of the airfoil, a spline encoding based on the Non-Uniform Rational B-Splines is 

as used. The spline is constructed from a set on N four-dimensional control points (x, y, z, w) that define the control 
polygon, where x, y, *are the three dimensional coordinates and w is a weight for the point A two dimensional cross 
section is obtained by setting the z-coordinate to zero. To minimize the dimension of the search space the weights of 
the control points are fixed so that the representation used is a regular B-spline in this example. 
[0073] Therefore every control point is described only by two parameters, i.e., the x and y coordinate of the point. 

40 Figure 4 illustrates a blade (solid line) that is generated by a spline with seven control points. The dotted line shows 
the corresponding control polygon. The population is initialized with a given blade to reduce the computation time. Two 
neural network models are used to approximate the pressure loss and the outflow angle respectively The development 
of the pressure loss and the outflow angle during the evolution process are shown in Fig 5. In 185 generations, the 
Navier-Stokes-Sotver has been called 874 times, which corresponds to about 73 generations of evolution on the original 

45 f itness function only. Then the evolution has been run for 73 generations and the results are given in Fig. 6. The pressure 
loss and outflow angle are 0.110 and 69.52 with the approximate models and 0.113 and 69.51 without the approximate 
models. The final optimization results with approximate models are comparable to those without approximate models, 
but the evolution process has converged in about 120 generations, in which fewer than 874 calls of Navier-Stokes 
solver are needed. This achieves an over 30 % reduction of computation time. 

50 

Claims 

1 . Method for the evolutionary optimization, 
55 comprising the following steps: 

- setting up an initial population as parents (S1 ), 

reproducing the parents to create a plurality of offsprings (S2, S3), 
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- evaluating the quality of the offsprings by means of a fitness function (S4), 
wherein selectively a original fitness function or an approximate fitness function can be used (S8), and 
5 - selecting the offspring(s) having the highest evaluated quality value as parents (S5), 

characterized in that 

the frequency of the use of the original fitness function is adaptable (S13) during the optimization process. 

10 2. Method according to anyone of the preceding claims, 
characterized In that 

the frequency of use defines a control cycle terminated by the use of the original function, wherein the approximate 
fitness function is updated (S13) at the end of every control cycle. 

15 3. Method according to claim 2, 
characterized In that 

a covariance matrix of the probability density function adapted during the evolutionary optimization is used for 
weighting new samples at the end of every control cycle. 

20 4. Method according to anyone of the preceding claims, 
characterized in that 

the fidelity of the approximate fitness function is estimated locally at the end of a control cycle (S13) based on 
every use of the original fitness function (S9) to adjust (S13) the future frequency of use of the original fitness 
function. 

25 

5. Method according to anyone of the preceding steps, 
characterized in that 

it comprises the following steps (S13) at the end of each control cycle: 

30 - calculating the current model error on the basis of the difference of the result of using the original fitness 

function and the approximate fitness function, respectively, and 

adapting the future frequency of use of the original fitness function on the basis of the current model error. 

6. Method according to anyone of the preceding claims, 
35 characterized in that 

the approximate fitness function is implemented by a neural network model. 

7. Method according to anyone of the preceding claims, 
characterized in that 

40 in case of the use of the original fitness function the quality of all offsprings of a generation is evaluated (S5). 

8. Method according to anyone of the preceding claims, 
characterized in that 

in case of the use of the original function the quality of only a selected number of offsprings of a generation eval- 
45 U ated. 

9. Computer software program for executing a method according to anyone of the preceding claims. 

10. Use of a method according to anyone of claims 1 to 8 for the optimization of spline encoded problems. 

50 

11. Use of a method according to anyone of claims 1 to 8 for the optimization of aerodynamic bodies, wherein the 
original function is calculated by a Navier-Stokes-solver. 



55 



12 



EP1205 877A1 




S4 



Rg.1 



Algorithm 
t:=0; 

encode and initialize P(0) 

decode and evaluate P(0) 

recombine P(t) 
mutate P(t) 

decode P(t) 
evaluate P(t) 
P(t+1) = select (P(t) 
encode P(t+1) 
t:=t+1 
until terminate 
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r; c Blade optimization with approximate models (a) Pressure loss 
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]n g Blade optimization with approximate models (a) Pressure loss 
y * (b) Outflow angle. 
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